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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments filed 01/28/09 have been fully considered but they are not 
persuasive. 

Applicant argues that Watanabe does not teach or suggest the first speech 
recognition engine permits a plurality of ports to be used on behalf of a plurality of users 
and the system further comprises a port monitor coupled to the first speech recognition 
engine and to the evaluation logic, wherein the port monitor determines a number of 
currently available ports and, based on the number of currently available ports 
exceeding a threshold selecting and using the first speech recognition engine 
(Amendment, pages 7 - 9). 

The examiner disagrees, since Watanabe discloses "detector can also be used 
to selectively switch an active one of a plurality of user channels to one of a 
smaller number of voice recognizers. A change-over switch 14 connects m voice 
pattern outputs to n separate recognition input terminals 121, 122, . . . , 12j, . . . , 12n 
of a recognition means 15 which recognizes the voices received on its n separate 
recognition input terminals as the outputs from the change-over switch 14. The 
recognition means 15 can recognize n separate voice simultaneously" (see 
Abstract, lines 7-10; col.4, lines 5-12; col.6, lines 4-6). Recognizing n separate 
voice simultaneously implies selecting and using the first speech recognition engine 
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based on the number of currently available ports exceeding a threshold, since more 
than one voice recognizers are used by the system. 



Claim Rejections - 35 USC § 103 

2. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

3. Claims 1 - 4, 6, 9 - 13, 15 -18, 21, and 22 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Endo et al., (US Patent 7,228,275) in view of Watanabe et 
al., (US Patent 4, 641,342). 

As per claims 1, and 9, 15, and 21, Endo et al., teach a system, comprising: 
a first speech recognition engine; a second speech recognition engine (Abstract, 
lines 1 - 3); and 

evaluation logic ("decision module") coupled to the first and second speech 
recognition engines, the evaluation logic evaluates the first and second speech 
recognition engines based on evaluation signals from a user and, based in part on the 
evaluation, selects one of said speech recognition engines to process additional speech 
signals from the user (Abstract, col.2, lines 28 - 48). 

However, Endo et al., do not specifically teach the first speech recognition engine 
permits a plurality of ports to be used on behalf of a plurality of users and the system 
further comprises a port monitor coupled to the first speech recognition engine and to 
the evaluation logic, wherein the port monitor determines a number of currently 
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available ports and, based on the number of currently available ports exceeding a 

threshold selecting and using the first speech recognition engine. 

Watanabe et al., teach detector can also be used to selectively switch an active 
one of a plurality of user channels to one of a smaller number of voice recognizers. A 
change-over switch 14 connects m voice pattern outputs to n separate recognition 
input terminals 1 21 , 1 22, . . . , 1 2j, . . . , 1 2n of a recognition means 1 5 which 
recognizes the voices received on its n separate recognition input terminals as the 
outputs from the change-over switch 14. The recognition means 15 can recognize n 
separate voice simultaneously (Abstract, lines 7-10; col.4, lines 5-12; col. 6, lines 4 
-6). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to recognize n separate voices simultaneously using a 
single recognizer as taught by Watanabe et al in Endo et al., because that would help 
monitor when to use different speech recognizers at the same time. 

As per claims 2, 1 0, Endo et al., in view of Watanabe et al., further disclose a 
switch coupled to the first and second speech recognition engines and the evaluation 
logic, wherein, based on the evaluation, the evaluation logic causes the switch to 
release a connection to the speech recognition engine that was not selected (Endo et 
al; "selects the speech text with the highest raw confidence score... for controlling the 
back-end application"; col. 6, lines 20 - 24). 
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As per claim 3, Endo et al., in view of Watanabe et al., further disclose a 
communications mechanism and, based on the evaluation, the evaluation logic selects 
the communications mechanism that is not the first or second speech recognition 
engines (Endo et al; "selects the speech text with the highest raw confidence score... for 
controlling the back-end application"; col.6, lines 14 - 24). 

As per claim 4, Endo et al., in view of Watanabe et al., further disclose if the 
number of currently available ports does not exceed the threshold, comparing outputs 
from the first and second speech recognition engines, and selecting the second speech 
recognition engine if the outputs are identical (Endo et al; "confidence scores are the 
same"; col. 8, lines 34 - 37) 

As per claim 6, Endo et al., in view of Watanabe et al., further disclose if the 
number of currently available ports does not exceed the threshold, the evaluation logic 
receives a first confidence score from the first speech recognition engine and a second 
confidence score from the second speech recognition engine and selects the second 
speech recognition engine if the confidence score of the second speech recognition 
engine is equal to or higher than a threshold (Endo et al; col .2, lines 45 - 48; col. 8, lines 
42-48). 

As per claims 1 1 , and 1 6, Endo et al., in view of Watanabe et al., further disclose 
means for evaluating a parameter comprises means for assessing the relative accuracy 
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of the first and second means for recognizing speech ("The first speech recognizer 
recognizes ... first confidence score indicating the level of accuracy of the first 
speech text. Likewise, the second speech recognizer also recognizes... a second 
confidence score indicating the level of accuracy of the second speech text"; 
Endo et al., col.2, lines 38 - 45). 

As per claims 1 2, and 1 7, Endo et al., in view of Watanabe et al., further disclose 
the means for evaluating a parameter comprises means for assessing the relative 
performance of the first and second means for recognizing speech ("the decision 
module selects either the first speech text or the second speech text as the output 
speech text depending upon which of the first and second confidence scores is 
higher"; Endo et al., col.2, lines 45 - 48; col.1 1 , lines 4 - 6). 

As per claims 1 3, and 18, Endo et al., in view of Watanabe et al., further disclose 
the first and second means for recognizing speech comprise a means for determining a 
confidence score associated with the voice input ("The first speech recognizer 
recognizes ... first confidence score indicating the level of accuracy of the first 
speech text. Likewise, the second speech recognizer also recognizes... a second 
confidence score indicating the level of accuracy of the second speech text"; 
Endo et al., col.2, lines 38 - 45). 
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As per claim 22, Endo et al., in view of Watanabe et al., further disclose if the 
number of available ports is below the threshold, by performing an action selected from 
the group consisting of comparing a relative accuracy of the first and second speech 
recognition engines, comparing the relative performance of the first and second 
recognition engines, and comparing a confidence score generated by the first and 
second speech recognition engines and a combination thereof ("The first speech 
recognizer recognizes ... first confidence score indicating the level of accuracy of 
the first speech text. Likewise, the second speech recognizer also recognizes... a 
second confidence score indicating the level of accuracy of the second speech 
text, the decision module selects either the first speech text or the second speech 
text as the output speech text depending upon which of the first and second 
confidence scores is higher"; Endo et al., col.2, lines 38 - 48). 

4. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Endo et 
al., (US Patent 7,228,275) in view of Watanabe et al., (US Patent 4, 641 ,342), and 
further in view of Kemble et al., (US Patent 7,072,837). 

As per claim 5, Endo et al., in view of Watanabe et al., do not specifically teach 
that the evaluation logic determines a response time for each of the first and second 
speech recognition engines and selects the second speech recognition engine if the 
response time of the second speech recognition engine is equal to or shorter than the 
response time of the first speech recognition engine. 
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Kemble et al., teach that the processing tasks can be allowed only a 
predetermined and limited amount of time for completion. Specifically, the speech 
recognition system can restrict the selection of recognition results to only those from 
possible recognition results provided by the processing tasks which complete execution 
within the predetermined time limit (col. 7, lines 51 - 57). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to consider response time in speech recognition systems 
as taught by Kemble et al., in Endo et al., in view of Watanabe et al., because the 
response time is more critical than the accuracy of the speech recognition (col. 7, lines 
50, and 51). 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to LEONARD SAINT CYR whose telephone number is 
(571) 272-4247. The examiner can normally be reached on Mon- Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571) 272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is (571)- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
LS 

04/02/09 



/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 



